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(57) A method for determining information parame- 
ters) useful in processing a digital image having color 
values with an extended color gamut, includes the steps 
of: adjusting the color values of the extended color gam- 
ut digital image to fit within a limited color gamut to form 
a limited color gamut digital image; determining a resid- 
ual image representing a difference between the ex- 
tended color gamut digital image and the limited color 
gamut digital image; and analyzing the residual image 
to determine one or more image information parameter 
(s) related to the information contained in the residual 
image such parameter(s) being useful in processing the 
digital image. 
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Description 

[0001 ] The present invention relates to the field of dig- 
ital imaging, and more particularly to representing an ex- 
tended color gamut digital image. 
[0002] In digital imaging systems, there are many 
ways to represent images in digital form. Not only are 
there many different formats of digital files, but there is 
also a large variety of different color spaces and color 
encodings that can be used to specify the color of digital 
images. 

[0003] In some cases, the color encoding may be in 
terms of a so-called device independent color space, 
such as the well-known CIELAB color space. In recent 
years, this color space has been used extensively to 
specify the color of digital images in color-managed dig- 
ital imaging systems. In some cases, the image may ac- 
tually be stored in the CIELAB color space. More com- 
monly, the color space may be used to connect device 
profiles, which can be used to describe the color char- 
acteristics of various color imaging devices such as 
scanners, printers, and CRT video displays. The KO- 
DAK Photo YCC Color Interchange Space is another ex- 
ample of a device independent color space that can be 
used to encode digital images. 

[0004] In other cases, the color-encoding may be in 
terms of a device dependent color space. Video RGB 
color spaces and CMYK color spaces are examples of 
this type. When a color image is encoded in a device 
dependent color space, it will have the desired color ap- 
pearance when it is displayed on the particular output 
device associated with that color space. The advantage 
of a device dependent color space is that the image is 
ready to be displayed or printed on the target device. 
However, the disadvantage is that the image will neces- 
sarily be limited to the color gamut of the target device. 
The color gamut of an imaging device refers to the range 
of colors and luminance values that can be produced by 
the device. Therefore, if the target device has a limited 
dynamic range, or is incapable of reproducing certain 
saturated colors, then it is not possible to encode color 
values outside of the range of colors that can be pro- 
duced on the device. 

[0005] One type of device dependent color space that 
has become quite widespread for use as a storage and 
manipulation color space for digital images is the video 
RGB color space. In reality, there are many different vid- 
eo RGB color spaces due to the fact that there are many 
different types of video RGB displays. As a result, a par- 
ticular set of video RGB color values will correspond to 
one color on one video display and to another color on 
another video display. Therefore, video RGB has histor- 
ically been a somewhat ambiguous color representation 
because the color values can not be properly interpreted 
unless the characteristics of the target video display are 
known. Nonetheless, video RGB color spaces have be- 
come the defacto standard in many applications be- 
cause the creation, display and editing of images on vid- 



eo displays are central steps in many digital imaging 
systems. 

[0006] Recently, there have been efforts to standard- 
ize a particular video RGB color space in order to re- 
5 move the ambiguity in the interpretation of the color val- 
ues. One such proposed standard color space is known 
as "sRGB." (See "Multimedia Systems and Equip- 
ment-Colour Measurement and Management-Part 2-1 : 
Colour Management-Default RGB Colour Space- 
sRGB," I EC"61 966-2-1) This color space specifies a 
particular set of red, green, and blue primaries, a partic- 
ular white-point, and a particular non-linear code value 
to light intensity relationship. Together, these tightly de- 
fine the overall relationship between the digital code val- 
ues and the corresponding device independent color 
values. 

[0007] Although the use of a standard video RGB 
color space eliminates much of the ambiguity usually as- 
sociated with video RGB color spaces, it does nothing 
to address the fact that this color space has a limited 
color gamut relative to other output devices. Additional- 
ly, any output device will have a limited color gamut rel- 
ative to that of an original scene. For example, a scene 
may have a luminance dynamic range of 1000:1 or 
more, whereas a typical video display or reflection print 
will have adynamic range on the order of 100:1 . Certain 
image capture devices, such as photographic negative 
film, can record dynamic ranges as large as 8000:1. 
Even though this is larger than the luminance dynamic 
range associated with most scenes, the extra dynamic 
range is often useful to provide allowance for exposure 
errors, light source variations, and so forth. 
[0008] In order to encode images from various sourc- 
es in a video RGB representation, it is necessary to dis- 
card information that is outside the color gamut of the 
video RGB color space. In some cases, such as when 
it is desired to encode the appearance of colors in an 
original scene or the colors captured by a photographic 
negative, a great deal of information will typically need 
to be discarded due to the large disparity in the dynamic 
ranges. For the case where it is desired to scan a reflec- 
tion print and store it in a video RGB color space, it is 
still necessary to discard a substantial amount of infor- 
mation due to the mismatch in the color gamuts, even 
though the luminance dynamic ranges may be quite 
similar. 

[0009] For example, FIG. 1 shows a comparison of a 
typical Video RGB Color Gamut and a typical Reflection 
Print Color Gamut. In this case, a*-b* cross-sections of 
the color gamuts are shown in the CIELAB space at an 
L* of 65. The colors that are inside the boundary are 
within the gamuts of the respective devices, while those 
that are outside the boundary cannot be reproduced, 
and are therefore referred to as "out-of-gamut" colors. 
It can be seen that there is a large set of color values 
with a b* value larger than 60 that can be produced on 
the printer, but are outside the color gamut of the video 
display. As a result, if the reflection print were scanned 
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and stored in a video RGB color space, it would not be 
possible to encode this color information. 
[0010] The mismatch between the video RGB color 
gamut and the color gamuts of other output devices and 
image sources represents a serious limitation on the 
usefulness of the video RGB color space. However, in 
many cases, the convenience of storing the image in a 
color space that is ready for direct display on a computer 
video CRT has been the over-riding factor in the deter- 
mination of the preferred color space. This has come at 
the expense of applications that can utilize the extended 
color gamut information that may have existed in an in- 
put image. This extended color gamut information can 
be useful for many different types of image processing 
operations. 

[001 1 ] It is an object of the present invention to over- 
come the limitations of the prior art by using a residual 
image to store the information that is lost during the 
process of forming a limited color gamut digital image 
from an extended color gamut digital image. The resid- 
ual image can then be analyzed to provide image infor- 
mation parameters that can be used in the process of 
applying one or more image processing operations to 
the digital image. 

[0012] These objects are achieved by a method for 
determining information parameter(s) useful in process- 
ing a digital image having color values with an extended 
color gamut, comprising the steps of: 

a) adjusting the color values of the extended color 
gamutdigital image to fit within a limited color gamut 
to form a limited color gamut digital image; 

b) determining a residual image representing a dif- 
ference between the extended color gamut digital 
image and the limited colorgamutdigital image; and 

c) analyzing the residual image to determine one or 
more image information parameter(s) related to the 
information contained in the residual image such 
parameter(s) being useful in processing the digital 
image. 

[0013] In another aspect of the present invention, the 
image information parameter(s) are used in the process 
of applying one or more image processing operations to 
the extended color gamut digital image or a derived dig- 
ital image formed from the extended color gamut digital 
image to form a modified digital image. 
[001 4] The present invention has an advantage in that 
a digital image can be stored in a color space convenient 
for a particular application while overcoming the color 
gamut limitation associated with that color space. Asso- 
ciated image information parameter(s) can then be used 
to select or modify image processing operations to be 
applied to the digital image. 

[001 5] The present invention has an additional advan- 
tage that it can be used to determine what image 
processing operations should be interactively presented 
to a user. 



[0016] FIG. 1 is graph comparing the color gamuts of 
a typical video display, and a typical reflection print; 
[0017] FIG. 2 is a flowchart showing the basic steps 
of the present invention; 
5 [0018] FIG. 3 is a flowchart showing the creation of a 
digital file in accordance with the present invention; 
[0019] FIG. 4 is a flowchart showing the formation of 
a modified digital image in accordance with the present 
invention; 

w [0020] FIG. 5 illustrates a communications network 
configuration for practicing the current invention; and 
[0021] FIG. 6 is a flowchart showing another embod- 
iment of the present invention using a generalized re- 
sidual image. 

15 [0022] A flowchart showing one embodiment of the 
present invention is given in FIG. 2. An extended color 
gamut digital image has color values that are outside 
the limited color gamut of a storage color space. An ad- 
just color values step is used to limit the color values to 
20 those that will fit within the limited color gamut of the 
storage color space to form a limited color gamut digital 
image. A compute residual image step is used to deter- 
mine a residual image representing the difference be- 
tween the extended color gamut digital image and the 
25 limited color gamut digital image. An analyze residual 
image step is then used to determine one or more image 
information parameter(s) by analyzing the residual im- 
age. The image information parameter(s) are then used 
in the process of applying one or more image processing 
30 operation(s). The image processing operation(s) can be 
applied to the extended color gamut digital image or a 
derived digital image formed from the extended color 
gamut digital image, to form a modified digital image. 
[0023] Each of the aspects of the invention shown in 
35 FIG. 2 will now be discussed in more detail. The extend- 
ed color gamut digital image can take many different 
forms. For example, the image can be a scanned pho- 
tographic print, a scanned photographic negative, a 
scanned photographic transparency, an image from a 
40 digital camera, or an image from another source such 
as a computer-generated digital image. Depending on 
the source of the image, as well as any image process- 
ing that has been applied to the image, the image may 
have very different color gamuts and color representa- 
45 tions. Images from scanned photographic negatives 
and digital cameras can contain scene information hav- 
ing a much larger luminance dynamic range than can 
be encoded in many storage color spaces. In this case, 
luminance dynamic range is simply one aspect of color 
50 gamut related to the range of luminance values that can 
be represented. 

[0024] The color gamut of an imaging system is the 
range of colors that can be represented or produced. 
Since color is fundamentally a three-dimensional phe- 
55 nomenon, color gamuts can be viewed as a three-di- 
mensional volume. Color values that are within the vol- 
ume are said to be "in-gamut," whereas colors that are 
outside the volume are said to be "out-of-gamut." One 
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aspect of the color gamut is the luminance dynamic 
range of the system. This is the range of relative lumi- 
nance values that can be encoded by the system from 
the whitest white to the blackest black. Another aspect 
of the color gamut is the range of chroma values that 
can be represented from a neutral out to a saturated 
color. The extended color gamut digital image will gen- 
erally have a larger luminance dynamic range and a 
larger range of chroma values than the limited color 
gamut digital image. The range of chroma values that 
are in-gamut will generally be a function of hue and light- 
ness. Generally, the highest chroma colors can be pro- 
duced near the hue and lightness of the primary and 
secondary colors of a given imaging device or color 
space (usually red, green, blue, cyan, magenta and yel- 
low). 

[0025] If the image were a scanned photographic 
print, the color gamut of the image would generally be 
the color gamut of the original photographic print medi- 
um. Likewise, if the image were captured by a digital 
camera, the color gamut of the image would generally 
be that of an original scene, although it may be limited 
by the dynamic range of the camera sensor and by lens 
flare. The color space that the image is represented in 
is somewhat independent of the color gamut of the orig- 
inal image. For example, the color values for a scanned 
photographic print can be represented as raw scanner 
code values, or they can be given by device independ- 
ent color values according to a color space such as the 
CIELAB color space. Alternatively, the color values can 
be expressed in some other color space. 
[0026] For many applications, it is convenient to store, 
display and manipulate the digital image in a particular 
storage color space that is well suited for the work flow 
associated with that application. Frequently, the storage 
color space that is chosen will be a device dependent 
color space associated with a common output device or 
medium used by the system. In many cases, video RGB 
color spaces are used because they can be displayed 
or previewed directly on a computer video display with- 
out any further processing. Additionally, many software 
applications that are available to manipulate images on 
a computer are designed to work with images in a video 
RGB color space. The color gamut of the storage color 
space will often be smaller than, or at least different 
from, the color gamut of the extended color gamut digital 
image. As a result, there generally will be colors in the 
extended color gamut digital image that can not be rep- 
resented in the limited color gamut storage color space. 
For example, consider the case where the extended 
color gamut digital image is a scanned photographic 
print. There are many colors within the color gamut of 
the reflection print that are outside the color gamut of 
the video RGB color space. This can clearly be seen in 
FIG. 1, which shows cross-sections through a typical 
Video RGB Color Gamut, and a typical Reflection Print 
Color Gamut. 

[0027] Therefore, information must be discarded in 



order to store the reflection print color values in a video 
RGB color space, or any other limited color gamut stor- 
age space. In prior art methods, the information that is 
discarded is lost permanently and can not be recovered. 
5 In the present invention, the information that is lost will 
be stored in a residual image. 

[0028] The adjust color values step is used to adjust 
the color values of the extended color gamut digital im- 
age to fit within the limited color gamut of the storage 

10 space, forming a limited color gamut digital image. In 
this step, information must be discarded when color val- 
ues that are outside the limited color gamut are mapped 
to color values within the limited color gamut. In some 
cases, the color values for the out-of-gamut colors are 

15 simply "clipped," that is, they are mapped to color values 
the surface of the limited color gamut. In other cases, 
more sophisticated gamut mapping methods can be 
used to compress the extended color gamut into the lim- 
ited color gamut without introducing a hard clipping func- 

20 tion. For example, the chroma of the input color values 
can be scaled so that the most saturated colors in the 
extended color gamut are mapped to the most saturated 
colors in the limited color gamut. Alternatively, a gamut 
mapping method can be used that is designed to pre- 

25 serve color appearance as closely as possible. Regard- 
less of what gamut mapping technique is used, there 
will necessarily be a loss of information and a distortion 
of the color characteristics of the image. 
[0029] In many cases, the extended color gamut will 

30 contain color values that have higher chroma values 
than can be represented in the limited color gamut. In 
some cases, the extended color gamut may also have 
a larger luminance dynamic range than can be repre- 
sented in the limited color gamut. In the case where it is 

35 necessary to reduce the luminance dynamic range of 
the image, one part in the implementation of the adjust 
color values step is typically the application of a tone 
scale function. The tone scale function might be applied 
to a luminance channel of the image, or alternatively to 

40 each color channel of an RGB color representation. In 
some applications, the image being processed may ac- 
tually be a monochrome image, for example, a black- 
and-white image. In this case, the tonescale function 
would be applied to the image luminance values. 

45 [0030] For cases where the extended color gamut dig- 
ital image is a representation of the colors in an original 
scene, the adjust color values step will typically involve 
determining reproduced color values that will produce 
desired aim colors on a target output device. For exam- 

50 pie, optimal color reproduction aims can be applied to 
determine desired video RGB aim colors for the original 
scene colors. The process of transforming the original 
scene color values into aim reproduced color values is 
sometimes referred to as "rendering" the image. 

55 [0031] A compute residual image step is used to de- 
termine a residual image representing the difference be- 
tween the extended color gamut digital image and the 
limited color gamut digital image. In its simplest form, 
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the residual image can be calculated by simply subtract- 
ing the adjusted color values of the limited color gamut 
digital image from the input color values of the extended 
color gamut digital image. The residual image would 
then be in terms of the color space used to represent 
those color values. Alternatively, the color values can 
be transformed into some other space that would be 
useful for computing the residual image. For example, 
it might be desirable to compute the residual image in a 
color space that is well-suited for compressing the re- 
sidual image or that is convenient for use in reconstruct- 
ing the extended color gamut digital image. Generally, 
the extended color gamut digital image and the limited 
color gamut digital image should be represented in the 
same color space before the residual image is calculat- 
ed so that the in-gamut colors will be given by zero re- 
sidual errors. Since most images will only have a small 
fraction of color values that are out of gamut, the residual 
image will be dominated by zeros, and therefore will be 
highly compressible. 

[0032] For cases where the adjust color values step 
involves the application of a transform that modifies the 
color values for the colors within the limited color gamut 
as well as those outside the limited color gamut, a re- 
sidual image determined by directly computing the dif- 
ference between the input color values of the extended 
color gamut digital image and the adjusted color values 
of the limited color gamut digital image would have a 
large number of non-zero values. This could be unde- 
sirable for cases where the residual image is to be com- 
pressed. The prior example where the extended color 
gamut digital image is a representation of the original 
scene, and the adjust color values step includes render- 
ing the color values to determine desirable color values 
for a target output device, will generally suffer from this 
problem. In this case, it can be desirable to apply a sec- 
ond rendering function to the extended color gamut dig- 
ital image to determine a second set of rendered color 
values that are desirable for another output device hav- 
ing a larger color gamut than the first target output de- 
vice. If the second rendering function were identical to 
the first rendering function throughout most of the color 
gamut, then a residual image computed by taking the 
difference between the first and second rendered imag- 
es would again be largely dominated by zero differenc- 
es. In one preferred embodiment of the present inven- 
tion, the first rendering function produces a rendered im- 
age that is optimized for a video display, and the second 
rendering function produces a rendered image that is 
optimized for some hypothetical output device having 
an idealized large color gamut. 

[0033] After the residual image has been calculated, 
an analyze residual image step is used to analyze the 
residual image to determine one or more image infor- 
mation parameter(s). The image information parameter 
(s) are used to quantify some aspect of the residual im- 
age that can be useful for influencing some aspect of 
one or more image processing operation(s) that can be 



applied to the digital image. For example, a simple im- 
age information parameter that can be computed would 
be the fraction of the image pixels where the residual 
image had non-zero values which would be an indica- 

5 tion of the relative amount of the image that is outside 
of the limited color gamut. Alternatively, a similar image 
information parameter would be the fraction of the im- 
age pixels where the absolute value of the residual im- 
age values exceeds some threshold value. This would 

10 provide a measure of the relative fraction of the image 
that is significantly outside of the limited color gamut. 
Both of these image information parameter variations 
can be computed by comparing pixel values of the re- 
sidual image to a threshold value on a pixel-by-pixel ba- 

15 sis, and counting the number of pixels exceeding the 
threshold. Variations on this basic theme would include 
determining a parameter relating to the amount, extent 
or distribution of the extended dynamic range informa- 
tion contained in the residual image, or the amount, ex- 

20 tent or distribution of extended color gamut information 
contained in the residual image. 

[0034] There are many other types of image informa- 
tion parameters that can also be determined. For exam- 
ple, statistical metrics could be computed from the re- 

25 sidual image. These statistical metrics would include the 
average magnitude of the residual image values, the 
variance of the residual image values, or higher order 
moments of the residual image values. These metrics 
would relate to how much information the residual image 

30 contains, as well as the nature of that information. For 
example, a residual image with a larger average mag- 
nitude will generally contain more information than one 
with a smaller average magnitude. 
[0035] Another class of image information parame- 

35 ters that can be computed include those based on the 
statistical information theory. Such image information 
parameters would include information content metrics 
such the well-known statistical entropy metric. (For 
more information on information theory concepts, 

40 please refer to Section 6.3 of "Digital Image Processing" 
by Rafael C. Gonzalez and Richard E. Woods, pub- 
lished by Addison-Wesley Publishing Co., 1992.) The 
image information parameters presented here are only 
examples of the types of parameters that can be used 

45 with the method of the present invention. It will be obvi- 
ous to one skilled in the art that there are many other 
types of image information parameters that could be 
used to represent the amount and characteristics of the 
information contained in the residual image. 

50 [0036] There are many ways that the image informa- 
tion parameter(s) can be used in the process of applying 
image processing operation(s). For example, there may 
be certain types of image processing operations that are 
appropriate for images with particular types of image 

55 content. Consider an image having an extended dynam- 
ic range, such as a back-lit image having a foreground 
region in the deep shadows, together with a brightly lit 
background region. Image processing operations could 
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be used to manipulate these images in such a way as 
to darken the brightly lit background region. Such image 
processing operations can be referred to as "scene-de- 
pendent tonescale operations" and may be automatic, 
or may require manual user interaction. In the case of 
an automatic image processing operation, an image in- 
formation parameter that is related to the amount, extent 
or distribution of extended dynamic range information in 
the image can be used to determine whether or not the 
image processing operation should be applied to the im- 
age. In the case of an image processing operation re- 
quiring manual user interaction, the image information 
parameter(s) can be used to determine whether or not 
to interactively present a choice to the user suggesting 
that the particular image processing operation should 
be applied to the image. For example, when the user 
accesses a high dynamic range image using an image 
processing workstation, the software can examine the 
image information parameter(s) and then display a mes- 
sage on the screen indicating that this particular image 
might benefit from the application of a scene-dependent 
tonescale operation and asking the user whether they 
would like to perform this operation. 
[0037] In addition to affecting whether or not an image 
processing operation is applied to an image, the image 
information parameter(s) can also be used to adjust one 
or more control parameters for an image processing op- 
eration. For example, a scene-dependent tonescale op- 
eration may make use of a contrast control value. The 
contrast control value can be set to higher or lower levels 
in response to an image information parameter relating 
to the amount, extent or distribution of extended dynam- 
ic range information in the residual image. Similarly, a 
color enhancement operation may have a control value 
used to modify the amount of overall color boost applied 
to an image. This control value can be adjusted in re- 
sponse to an image information parameter relating to 
the amount, extent or distribution of extended color 
gamut information in the residual image. 
[0038] Once the residual image has been calculated, 
it can be associated in some fashion with the limited 
color gamut digital image, such that the limited color 
gamut digital image and the residual image are adapted 
to be used to form a reconstructed extended color gamut 
digital image. This can involve storing the residual im- 
age in a memory buffer that is associated with a second 
memory buffer used to store the limited color gamut dig- 
ital image. Alternatively, many applications will store the 
image data in a digital file on some sort of digital storage 
media such as a magnetic disk, an optical disk, or a PC- 
MCIA card. This configuration is shown in FIG. 3. Where 
elements of this figure are the same as those in FIG. 2, 
identical numbers have been used. In this case, the lim- 
ited color gamut digital image, the residual image and 
the image information parameter(s) are stored in a dig- 
ital image file using a store in digital file step. In many 
cases, the file format used to store the storage space 
digital image may support the use of private tags to store 



additional data. For example, the file formats TIFF, EXIF 
and FlashPIX all support tags of this sort. These tags 
are sometimes referred to as "meta-data." In cases 
where file formats of this type are used, the residual im- 

5 age data and the image information parameter(s) can 
be stored in the form of meta-data tags in the image file. 
In this way, applications that do not know how to make 
use of the meta-data tags will simply ignore them, and 
will therefore have access only to the limited color gamut 

10 digital image. Whereas applications that know how to 
use the meta-data tags will be able to make use of them 
to reconstruct the extended color gamut digital image 
and use the image information parameter(s) accordingly 
in the process of applying image processing operations. 

15 in an alternate implementation of the present invention, 
the residual image and/or the image information param- 
eters) could be stored in one or more additional digital 
files that can be associated with a digital file used to 
store the limited color gamut image. 

20 [0039] FIG. 4 shows an example of reconstructing an 
extended color gamut digital image from the limited 
color gamut digital image and the residual image, and 
subsequently using the image information parameter(s) 
in the process of applying one or more image processing 

25 operations. The input to this process is a digital image 
file formed using the method of FIG. 3. An extract data 
from digital file step is used to extract the limited color 
gamut digital image, the residual image and the image 
information parameter(s). A reconstruct extended color 

30 gamut digital image step is then used to form a recon- 
structed extended color gamut digital image by combin- 
ing the limited color gamut digital image and the residual 
image. Typically, this will be done by reversing the steps 
used to form the limited color gamut digital image and 

35 the residual image. The limited color gamutdigital image 
and the reconstructued extended color gamut digital im- 
age are examples of derived digital images formed from 
the original extended color gamut digital image. 
[0040] Next the image information parameter(s) are 

40 used in the process of applying one or more image 
processing operation(s) that are applied to the recon- 
structed extended color gamut digital image to form a 
modified digital image. In a variation of this method, the 
image information parameters) can be used in the proc- 

45 ess of applying image processing operations that are 
applied directly to the limited color gamut digital image 
rather than the reconstructed extended color gamut dig- 
ital image. 

[0041] The modified digital image can be used for 
50 many different purposes. For example, the modified dig- 
ital image can be printed using a digital printer, such as 
an ink jet printer, a thermal dye sublimation printer, or a 
printer using photographic paper. In other cases, it will 
be desirable to store the modified digital image for sub- 
55 sequent use, such as by writing the modified digital im- 
age back out to a new digital file. In this case, a new 
limited color gamut digital image and a new residual im- 
age can be calculated to encode the modified image, 
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using the methods described by this invention. The 
modified digital image file can then be stored on a digital 
storage medium for access at a later time. 
[0042] When the method of the present invention is 
practiced in a commercial imaging system, it will typical- 
ly be desirable to obtain payment from a user in return 
for the service performed. The payment can be obtained 
at a number of different steps in the process. For exam- 
ple, payment can be obtained at the time that the cus- 
tomer provides input images to be processed. Alterna- 
tively, payment can be obtained when digital image files 
are provided to the user, at the time when image 
processing operations are performed on the digital im- 
ages, or at any other stage in the process. In some cas- 
es, it may be desirable to obtain payment at multiple 
steps. For example, payment could be obtained when 
digital image files are provided to the user, and addition- 
al payment can be obtained when the user requests that 
additional image processing operations be applied to a 
selected digital image. Payment can be obtained from 
the user using many different methods. For example, 
payment can be obtained using a cash transaction, or 
by obtaining a payment identifier from user. The pay- 
ment identifier can include information about an account 
from which payment is to be electronically transferred. 
Alternatively, the payment identifier can include a credit 
card account where the payment is to be debited. Other 
forms of payment identifiers are also possible including 
a check, and so forth. In one embodiment of the present 
invention, the payment identifier is obtained from the us- 
er via a digital communications network such as the In- 
ternet. 

[0043] FIG. 5 illustrates an embodiment of the present 
invention where the digital image files are accessed by 
a digital communications network, such as the Internet. 
In this case, an image database is located on a network 
server. The image database is used to store digital im- 
age files that have been processed using the methods 
described earlier and will contain limited color gamut 
digital images, together with associated residual images 
and image information parameters. The network server 
is connected to a communications network. For exam- 
ple, the communications network could be the Internet, 
or a local area network. A user uses a processor to ac- 
cess the network server via the communications net- 
work. The processor can be a home computer, or alter- 
natively it could be a computer in a retail kiosk, and so 
forth. Typically, the processor would use a monitor for 
the purpose of displaying preview images, and providing 
information to the user. One or more input devices can 
be used by the user to provide instructions to the proc- 
essor. Examples of typical input devices would include 
a keyboard, a mouse, a trackball, a touch pad or a touch 
screen. A printer may also be connected to the proces- 
sor for providing output prints to the user. Alternatively, 
a remote printer could also be accessed over the com- 
munications network. A card reader can also be con- 
nected to the processor for purposes of reading account 



information from a credit card or a debit card as part of 
the process of obtaining payment a user. 
[0044] Other network servers can also be attached to 
the communications network. For example, considerthe 

5 case where a user makes payment via a communica- 
tions network. One common way for the user to provide 
a payment identifier to a service provider would be for 
him or her to supply a valid credit card number. The serv- 
ice provider would then access a user account database 

10 on a network server to debit the appropriate payment, 
which would then be credited to an account specified by 
the service provider by accessing a service provider ac- 
count database on another network server. After the 
payment has been transferred, the service provider 

15 would then provide the requested service to the user. 
[0045] A flowchart showing an embodiment of the 
present invention using a generalized residual image is 
shown in FIG. 6. An input digital image is processed us- 
ing one or more image processing operation(s) to form 

20 one or more modified digital image(s) corresponding to 
images in different imaging states. The image process- 
ing operation(s) can include any type of image process- 
ing operation such as sharpening operations, color en- 
hancement operations, noise removal operations, arti- 

25 fact removal operations, and so forth. One of the digital 
images (either the inputdigital image, or one of the mod- 
ified digital images) is then designated as a reference 
digital image, and a compute residual image(s) step is 
used to determine one or more residual image(s) repre- 

30 senting the difference between the reference digital im- 
age and another of the digital images. An analyze resid- 
ual image(s) step is then used to determine one or more 
image information parameter(s) by analyzing the resid- 
ual image(s). The image information parameter(s) can 

35 relate to any type of information about the residual im- 
age, including measures of the amount and character- 
istics of the information contained in the residual image 
(s). The image information parameter(s) are then used 
in the process of applying one or more additional image 

40 processing operation(s) to the input digital image or a 
derived digital image formed from the input digital image 
to form a modified digital image. 

[0046] A computer program product having a compu- 
ter readable storage medium can have a computer pro- 

45 gram stored thereon for performing all the steps of the 
present invention. The computer readable storage me- 
dium can comprise, for example; magnetic storage me- 
dia such as magnetic disc (such as a floppy disc) or 
magnetic tape; optical storage media such as optical 

50 disk, optical tape, or machine readable bar code; solid 
state electronic storage devices such as random access 
memory (RAM), or read only memory (ROM); or any oth- 
er physical device or medium employed to store a com- 
puter program 

55 [0047] Other features of the invention are included be- 
low. 

[0048] The method where the image information pa- 
rameters) are used in the process of applying an adap- 
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tive tonescale operation. 

[0049] The method where the image information pa- 
rameters) are used in the process of applying a color 
enhancement operation. 

[0050] The method wherein the residual image is as- 
sociated with the limited color gamut digital image such 
that the associated residual image and the limited color 
gamut digital image are adapted to be used to form a 
reconstructed extended color gamut digital image. 
[0051] The method wherein the derived digital image 
is a reconstructed extended color gamut digital image 
that is formed from the limited color gamut digital image 
and the residual image. 

[0052] The method further including the step of print- 
ing the modified digital image. 

[0053] The method where the modified digital image 
is stored on a network server for subsequent access. 
[0054] The method where the limited color gamut dig- 
ital image is included in a digital image file which is 
stored using a digital storage medium. 
[0055] The method where the residual image is in- 
cluded as additional data in the digital image file. 
[0056] The method where the image information pa- 
rameter is included as additional data in the digital im- 
age file. 

[0057] The method where the extended color gamut 
digital image originates from scanning a photographic 
image. 

[0058] The method where the photographic image is 
a photographic print, a photographic negative or a pho- 
tographic transparency. 

[0059] The method where the extended color gamut 
digital image is provided from a digital camera. 
[0060] The method where the extended color gamut 
digital image is a computer-generated image. 
[0061] The method further including the step of ob- 
taining payment from a user. 

[0062] The method further including the step of ob- 
taining a payment identifier from the user. 
[0063] The method where the payment identifier in- 
cludes information about an account from which pay- 
ment is to be electronically transferred. 
[0064] The method where the payment identifier in- 
cludes a credit card account where the payment is to be 
debited. 

[0065] The method further including the step of pro- 
viding a reader for reading a credit card from the user. 
[0066] The method where the payment identifier is ob- 
tained from the user via the communications network. 
[0067] A computer storage product having at least 
one computer storage medium having instructions 
stored therein causing one or more computers to per- 
form the method of claim 1 . 



Claims 

1 . A method for determining information parameter(s) 



useful in processing a digital image having color val- 
ues with an extended color gamut, comprising the 
steps of: 

5 a) adjusting the color values of the extended 

color gamut digital image to fit within a limited 
color gamut to form a limited color gamut digital 
image; 

b) determining a residual image representing a 
10 difference between the extended color gamut 

digital image and the limited color gamut digital 
image; and 

c) analyzing the residual image to determine 
one or more image information parameter(s) 

15 related to the information contained in the re- 

sidual image such parameter(s) being useful in 
processing the digital image. 

2. The method of claim 1 further including the step of: 

20 

d) using the image information parameter(s) in 
the process of applying one or more image 
processing operations to the extended color 
gamut digital image or a derived digital image 

25 formed from the extended color gamut digital 

image to form a modified digital image. 

3. The method of claim 1 wherein determining the im- 
age information parameter(s) includes the step of 

30 computing statistical metrics from the residual im- 
age. 

4. The method of claim 1 wherein determining the im- 
age information parameter(s) includes comparing 

35 pixel values for the residual image to a threshold 
value to determine the number of pixels exceeding 
the threshold value. 

5. The method of claim 1 wherein determining the im- 
40 age information parameter(s) includes computing 

the statistical information content of the residual im- 
age. 

6. The method of claim 1 wherein determining the im- 
45 age information parameter(s) includes determining 

a measure of the amount, extent or distribution of 
extended dynamic range information included in the 
residual image. 

50 7. The method of claim 1 wherein at least one image 
information parameter(s) relates to the amount, ex- 
tent or distribution of extended color gamut informa- 
tion included in the residual image. 

55 8. The method of claim 2 where step d) includes using 
the image information parameter(s) to identify a 
suggested image processing operation. 
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The method of claim 8 further including the step of 
interactively presenting the suggested image 
processing operation to a user. 

A method for determining information parameter(s) 5 
useful in processing an input digital image compris- 
ing the steps of: 

a) manipulating an input digital image using at 
least one image processing operation to form 10 
at least one modified digital image in a different 
image processing state; 

b) designating either the input digital image or 
one of the modified digital image(s) to be a ref- 
erence digital image in a reference image 15 
processing state; and 

c) determining at least one residual image rep- 
resenting the difference(s) between the refer- 
ence digital image and another of either the in- 
put digital image or the modified digital image 20 
(s); and 

d) analyzing the residual image to determine 
one or more image information parameter(s) 
related to the information contained in the re- 
sidual image such parameter(s) being useful in 25 
processing the input digital image. 
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